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Parameter estimation from measurements along quantum trajectories* 
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Abstract 

The dynamics of many open quantum systems 
are described by stochastic master equations. In the 
discrete-time case, we recall the structure of the derived 
quantum filter governing the evolution of the density op¬ 
erator conditioned to the measurement outcomes. We 
then describe the structure of the corresponding par¬ 
ticle quantum filters for estimating constant parameter 
and we prove their stability. In the continuous-time (dif¬ 
fusive) case, we propose a new formulation of these 
particle quantum filters. The interest of this new for¬ 
mulation is first to prove stability, and also to provide 
an efficient algorithm preserving, for any discretization 
step-size, positivity of the quantum states and parameter 
classical probabilities. This algorithm is tested on ex¬ 
perimental data to estimate the detection efficiency for a 
superconducting qubit whose fluorescence field is mea¬ 
sured using a heterodyne detector. 

1. Introduction 

Parameter estimation in hidden Markov models is 
a well established subject (see, e.g., Cl). Twenty years 
ago Mabuchi lITSll has proposed maximum likelihood 
methods to estimate Hamiltonian parameters. Later on, 
Gambetta and Wiseman na have given a first formu¬ 
lation of particle filtering techniques for classical pa¬ 
rameter estimation in open quantum systems. This for¬ 
mulation has been analyzed in lH via an embedding in 
the standard quantum filtering formalism. Recently Ne- 
gretti and Mplmer m have exploited this embedding 
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to derive the general equations of a particle quantum fil¬ 
ter for systems governed by stochastic master equations 
driven by Wiener processes (diffusive case). In these 
contributions, realistic simulations illustrate the interest 
of such filters for the estimation of continuous param¬ 
eters. In El, similar filters are used for purely dis¬ 
crete parameters in order to discriminate between dif¬ 
ferent topologies of quantum networks. The Bayesian 
parameter estimation used in the measurement-based 
feedback experiment reported in ||4l is in fact a spe¬ 
cial case of particle quantum filtering when the quantum 
states remain diagonal in the energy-level basis, reduce 
to populations and classical probabilities. 

The contribution of this paper is twofold; with the¬ 
orem |2] we show that particle quantum filters are al¬ 
ways stable processes; with lemmawe propose and 
justify a new positivity preserving formulation in the 
diffusive case. This formulation is shown to provide an 
efficient algorithm for precisely estimating the detection 
efficiency from experimental heterodyne measurements 
of the fluorescence field that is emitted by a supercon¬ 
ducting qubit a. The statistics of the measurement out¬ 
comes generated by this system cannot be described by 
classical probabilities since the density operators at var¬ 
ious times do not commute. As far as we know, this 
is the first time that a particle quantum filter is applied 
to an experiment a whose measurement statistics are 
ruled by non-commutative quantum probabilities. 

Section a is devoted to the discrete-time formula¬ 
tion. The specific structure of Markov models describ¬ 
ing open-quantum systems is presented. Then particle 
quantum filters are detailed and shown to be always sta¬ 
ble (theorem |2]i. Finally, the link with MaxLike ap¬ 
proach and the case of multiple measurement records 
are addressed. In section [3] a positivity preserving for¬ 
mulation of particle quantum filters is proposed for dif¬ 
fusive systems. The mathematical justifications of this 
formulation is given in lemma |2] In section H] the nu¬ 
merical algorithm underlying Iemma|2]is applied on ex¬ 
perimental data from which the detection efficiency is 
estimated and compared to an existing calibration pro- 



tocol. 

2. Discrete-time formulation 
2.1. Markov models 

In the sequel, 'H is the finite-dimensional Hilbert 
space of the system and expectation values are denoted 
by the symbol E(.)- In this section, time is indexed by 
the integer A: = 0,1,... The measurement outcome at k is 
denoted by yk- It corresponds to a classical output sig¬ 
nal. We limit ourselves to the case where each yk can 
take a finite set of values 6 {1,...,m), m being a pos¬ 
itive integer (for continuous values of y, see section |2l. 
We denote by pk the density operator at time-step k (an 
Hermitian operator on “K such that Tr(pjt) = 1, > 0). 

It corresponds to the conditional quantum state at time k 
knowing the initial condition po and the past outcomes 
yi,...,yk- According to the law of quantum mechan¬ 
ics, Pk is related to pk-\ via the following Markov pro¬ 
cess (see, e.g., l|22l) corresponding to a Davies instru¬ 
ment |[9) in a discrete context; 

Kyi^(pk-\) 

Pk^—, -T (1) 

Tr{Ky,{pk-x)) 

where the super-operator p Ky{p) depends on y, is 
linear and completely positive. It admits the follow¬ 
ing Kraus representation Ky(p) - 2^M^p(M^)^ where 
the operators on “Tf, (M^), satisfy ~ 

with the identity operator. Moreover the probability 
^(yk -y\po,y\,---,yk-\) to detect yk knowing the past 
outcomes and the initial state po, depends only on pk-\ 
(Markov property) and is given by 

f{yk = y\pk-i) = Ti-(^Ky{pk-i)). 

Notice that ¥,{pk\pk-'i) - K(pk-\) where K(p) - 
YjyKy(p) - is ^ Kraus map (a quantum 

channel) since it is not only completely positive but also 
trace preserving: Tr(^r(p)) = Tr(p). In the sequel, Ky is 
called a partial Kraus map since it is not trace preserving 
in general: Tr(k'y(p)) < Tr(p). See, e.g., fTOllJl for a de¬ 
tailed construction of such Ky based on positive opera¬ 
tor value measures (POVM) and left stochastic matrices 
modeling measurement uncertainties and decoherence. 

Now, we consider that the partial Kraus maps 
(/(!,•),•= can depend on time k, {Ky,k), and on some 
physical parameters, grouped in the scalar or vectorial 
time-invariant p, whose exact value p may not 

be known with a sufficient precision, and whose esti¬ 
mation is the subject of this paper. Here, we consider 
the case where the only reliable resource of information 


is some independent series of measurement outcomes, 
(yk)k=\,...,T, associated to a quantum trajectory of dura¬ 
tion T. Starting from the exact quantum state pg and 
the exact parameter value p, the exact quantum state 
trajectory (Pk)k=i,...,T is given by the following Markov 
process: 


K,yPl:-0 


( 2 ) 


with the following probability of outcome yk knowing 
Pk-i andp; 


= y I Pk-up) = Tr(/(:^_^(p*^_i)). 


2.2. Particle quantum filters 


The parameter estimation method described in im 
ElIISl for continuous-time quantum trajectories admits 
the following discrete-time formulation. When the ex¬ 
act parameter value p and the initial state pQ are un¬ 
known, one can still resort to the approximate filter cor¬ 
responding to its a priori estimate value p, with partial 
Kraus maps ,, an initial guess for po and following 


states p^ satisfying p^ 




Here, the mea- 


surement outcomes (yk)k=i,...,T correspond to the hidden 
state Markov chain defined in (|2]l and involving the ac¬ 
tual value p of the parameter. 

Assume that the initial information of the true pa¬ 
rameter value p is that it can take only two different 
values a or b. This initial uncertainty on the value of 
p can be taken into account by using an extended den¬ 
sity operator, denoted ^ = diag(^",^*), block diagonal, 
where the first block corresponds to p - a, and the 
second block to p-b. The evolution of each block is 
then handled with the corresponding partial Kraus maps 
(/(T"^) and (k'^^j.) forming extended partial Kraus maps 

Sy /t = diag(k'"j,,/(r^^) between block diagonal density 
operators on the Hilbert space 'Hx'H: 

Hy, ,: ^ ^ diag(/ir;; ,(^), o) 

The associated extended quantum filter reads: 


^k- 


^yk,ki^k-t) 


(4) 


For p 6 {a,b], the probability that p = p at step 
k knowing the initial quantum state Pq and initial pa¬ 
rameter probability reads = Tr^^^). In¬ 

deed, tt" -HTT* = 1 since Tr(^) = Tr(f') + Tr(f*) = 1, 
and ^0 = diag(7rJjpo,7rQPo). If the initial information on 






the parameter value is only its belonging to {a,b}, then 
^ 0=^0 = 1 / 2 . 

Instead of using ^ = diag(^“,^^) itself, we decom¬ 
pose its terms into products of probabilities nP and den¬ 
sity operators pP - ^p jnP. Then Eq. (|4]i reads 


diag(po,0). Then ^ s (p,0) and thus (f,^) is solution of 
the extended Markov chain 

I ^ '^yk,k(ik-\) ^ ^yk,k{^k-\) 

' Tr(H,,,,(|,_i))’ ' Tr(H,,,,(ft_i)) 


P’h 






iKkM-o) 


(5) 


for p e {a,b}. In the sequel, we will identify the filter 
state ^ with {p" ,p^ ,jf ,n^). 

We have the following stability result based on lfT9l 
ED and relying on the fidelity F(p,p') e [0,1] between 
two density operators p and p' defined here as the square 
of the usual fidelity function used in quantum informa¬ 
tion IfTTl : 

F(p,p') = Tr^ I ^ ^p' . 

Theorem 1. Take an arbitrary initial quantum state 
Pq and a parameter value p. Consider the quantum 
Markov process © producing the measurement record 
yk, k > 0. Assume that the constant parameter p can 
only take two different values, a and b. Consider the 
particle (quantum)filter (0 initialized with Pq-Pq- po 
[po any density operator) and ( 71 ^, 71 ^ 6 [0,1]^ with 
71^ + 71^ — 1. Then F(p,pP) and 7rPF(p,pP) are sub¬ 
martingales of the Markov process (El) and (O of state 

(p,p“,p^7r^;r'’).■ 

When po = Po, we have pP = p, F{p,pP) = 1. Thus 
ttP is a sub-martingale 

^[’^k \Pk-U^k-l)^7TP_^ 

This means that, in practice, the component of tt associ¬ 
ated to the true value of the parameter tends to increase. 


with measurement outcome yk of probability 
P(w=y|li:-i) = Tr(Sv,A:(|<-_i)) depending only 
on ^k-i- Thus according to 11211 theorem IV. 1], F(^,fi) 
is a sub-martingale. Due to the block structure of 
f - diag(p,0) and f - diag(n-"p",7r*p*), we have 
F{fS = 7t“F(p,p‘‘). □ 

Extension of theoremElto an arbitrary number r of 
parameter values is given below, the proof being very 
similar and not detailed here. 

Theorem 2. Take an arbitrary initial quantum state pg 
and parameter value p. Consider the quantum Markov 
process (EJ producing the measurement record yk, k>0. 
Assume that the parameter p belongs to a set of r differ¬ 
ent values (pi)i=i,...,r- Take, for I — l,...,r, the particle 
quantum filter 

initialized with p^‘ = po (po any density operator) and 
(;r^‘,...,7r^'') e [0,1]'' with = 1. 

Then F(p,pP) and 7TPF(p,pP) are sub-martingales 
of the Markov process driven by (El) and of state 
{p,pP^ ,... ,pP'',^’’^, ■ ■ 

Extension to a continuum of values for p of such 
particle quantum filters and of the above stability result 
can be done without major difficulties. 

2.3. Connexion with MaxLike methods 


Pk 


Proof The fact that F(p,pP) is a sub-martingale is a 
direct consequence of liHl theorem IV. 1]: (p,pP) is the 
state of the following quantum Markov chain 

_ _ KkiPk.o __ Kikipl,) 

with initial state (po,po) and measurement outcome yk 
whose probability = y | p^_j) = Tr^/(r^^(pi,_i)j de¬ 
pends only on Pk-\- 

For instance, assume that p - a. Denote by f 
the state of the quantum filter (lH initialized with fg = 


Assume that the initial density operator is well 
known: po -po- It is possible to choose as an es¬ 
timation of p, among a or b, the value p that max¬ 
imises the probability after a certain amount of 
time k. This method is actually a maximum-likelihood 
based technique. The multiplicative increment at 

time k for is Tr^/iT"^ ^(p^_j)j, which is equal to 

P^yjt I po,yi,... ,yk-i,P - aj. From this observation, we 
deduce that 

















where Cjt is a normalization factor to ensure = 1. 

Remarking that the probability of the measurement out¬ 
comes {yi)i<k is the probability of the measurement out¬ 
comes (yi)i<k-i times the probability ofy^t conditionally 
to all prior measurements, one gets 

< = |po,;p = a), 

and similarly 

^k = ^xP^yi,...,yA: |po,P = ^)- 

Choosing as an estimate the value a or b whose asso¬ 
ciated component of tt tends towards 1 thus amounts to 
choosing the parameter value that maximises the prob¬ 
ability of the measurement outcomes (y i,... ,y 7 '). 

2.4. Multiple quantum trajectories 


3. Continuous-time formulation 

3.1. Diffusive stochastic master equations 

For a mathematical and precise description of such 
diffusive models, see 0. We just recall here the 
stochastic master equation governing the time evolution 
of the density operator pt 

m 

dpf = ^ - i[H,p,] + ^ £>y(pt)j dt 

V=1 

m 

+ ^ \^vPt +PtLl - Tr{Lypt + ptll'^pt^dW'! ( 6 ) 

V=1 

where H is the Hamiltonian, an Hermitian operator on 
'H {h= I here) and where, for each v 6 {1,... ,m), 

• Dy is the Lindblad super-operator 

Dv(p) - Lypll - jiLllyP + pLlly)-, 


Such particle quantum filtering techniques ex¬ 
tend without difficulties to N records (indexed by n 6 

(n't 

{1,.. W)) of measurement outcomes, )k=i,...,Tn 
possibly different lengths T„ and initial conditions Pq"\ 
This extension consists in a concatenation of the N 
records into a single record (yk)k=i,...,T with T - Yjn=i 
and 


(yk)k=l,...,T - 

(y,'>..y,".y^j 


• Ly is an operator on '7T, which is not necessarily 
Hermitian and which is associated to the measure¬ 
ment/decoherence channel v; 

• 77v e [0,1] is the detection efficiency (r]y = 0 for 
decoherence channel and rjy > 0 for measurement 
channel); 

• Wf is a Wiener process (independent of the other 

Wiener processes describing the quantum 

fluctuations of the continuous output signal 

It is related to p, by 


This record can be associated to a single quantum tra¬ 
jectory of length T of form (|2]). First initialize at pg \ 
Then for each k equal to Ti -i-... H- T^-i, pk+i is reset to 
p|j"\ This can be done by applying a reset Kraus map 

K^o after the computation of Pj^+j relying on outcome 
yj~^^ and before using the outcome y^"\ For any den¬ 
sity operator cr, it is simple to construct via its spec¬ 
tral decomposition, a Kraus map such that, for all 
density operator p, K°'{p) - cr. With this trick (yk) is 
associated to an effective single quantum trajectory of 
the form (l2]l where the partial Kraus maps depend 
effectively on the time step k because of adding these 
reset Kraus maps. 

For the particle quantum filter that is described in 
theorem|2]and associated to the record (jk), each p'^'^ is 
reset in a similar way at each time step k-Ti +... + T„-i 
contrarily to the parameter probability that is not 
reset. 


dy;' = Tr(L,p, +p,4) df + dW';. (7) 

3.2. Partial Kraus map formulation 

We introduce here another formulation of ® that 
mimics the discrete-time formulation (|2]i. This formu¬ 
lation is inspired of subsection 4.3.3 of ITT^ . subsec¬ 
tion entitled ’’Physical interpretation of the master equa¬ 
tion”. In (|6]l, dp, stands for p,+d,-p,. It can thus be 
written as 

m 

Pt+dt = Pf + ^ - i[H,pt] + '^Dy{pt)^dt 

y=l 

m 

+ ^ ^|^h \^ypt +PtlX - Trilyp, + ptll'^pt^dW'l 

y=l 

i.e., p,+d, is an algebraic expression involving p,, df and 
dVT,’'. With this form, it is not obvious that p,+d, remains 


a density operator if pt is a density operator. The fol¬ 
lowing lemma provides another formulation based on 
Ito calculus showing directly that pr+dr remains a den¬ 
sity operator. In ll20l . similar formulations are proposed 
without the mathematical justifications given below and 
are tested in realistic simulations of measurement-based 
feedback scheme. 

Lemma 1. Consider the stochastic differential equa¬ 
tion dSll with an initial condition po, which is a non¬ 
negative Hermitian operator of trace one. Then it also 
reads: 

^dyi.dt(Pt) 

Pt+At - --T, 

Tr[Kdy,4t{pt)) 

where dyt stands for {dy],.. .,dyf), and where K/yyjyt is 
a partial Kraus map depending on Ay e R”” and At >0 
given by 

m 

KAy,At(p) = MAy,At p ^ly^At 

v=\ 

and M/yy 4 t is the following operator on "H 


One recognizes ([8]) since dy, - ffrf[x{Lptp,L^^At - 
dWt- For m > 1, the computations are similar and not 
detailed here. □ 

3.3. Particle quantum filtering 

Assume the system dynamics depends on a con¬ 
stant parameter p appearing either in the SME (|6]l 
and/or in the output maps (|7]i. As in section |2] assume 
that p can take a finite number r of values pi, pr- 
Denote by p^ the quantum state associated to p; 

m 

dpf = X^lpf/df + ^ M^(pf)dlT; (9) 

v=\ 

where the super-operators 
Jl^ip) = -i[HP,p] 

m .. 

+ ^LPp(L?)^- i((LP)^L?p + p(LP)^LP) 

V=1 

and 


-^Ay.Af - tp ■ 


i//+£ illy 12 Af -H ^ sfn^Ay'’ Ly 


y y=l / v=l 

Proof Assume that m—l. Then, 

dpf = ^ - i[H,pt\ + LpfL^ - jiL^Lpt -i-p,L^L)jdf 

-H sffj ^Lp, A-ptL^ - Tr(Lp, -i-p,L^)p,jdVT,. (8) 

Using Ito rules, dy^ = df. Hence, we have 

Kdy„dt(Pt) =Pt+ sfniLpt +PtL^) dy, 

-I- {-i[H,pt] + Lp,L} - ^0Lpt +p,l'^L)) df. 

Thus Tr^/sTdiv.drCPf)) = 1 + V^r^Lpf-Hp,L'l‘)dy, and 


M^P)^ (L?p+p(L?)^-Tr(L^p+p(L^)t)p) 

depend on p since the operators Ly and the efficiencies 
qy could depend on p. The m outputs that are associated 
to the parameter p then read: 

£/y;' = cP(pf)df+diT; (10) 

for V - 1,..., m, and where: 

C^(P)= V^Tr(L^p+p(L?)t). 

With these notations, the particle quantum filter in¬ 
troduced in im and further developed and analyzed 
in MM reads as follows. For each I e {1,...,r), p^‘ 
is governed by the quantum filter: 


Tr(/srdy,,dr(Pl)) 

We get 


= 1 - ^JrA^i[Lpt+ptL'^)dy, 


+ qjf' [Lpt + PfL^) df. 


-Pt 


Tr(^:d>,,dr(Pi)) 

= V^^Lp,H-p,L''‘-Tr(Lp,-HprL^)p,jdy, 

-H [-i[H,pt\ + Lp,L^ - ^{L^Lpt + ptL^L)) df 
- ?7Tr(Lp, -i-p,L^) ^Lpf -i-p,L^ - Tr(Lp, H-p,L''‘)p,j df. 


dpf' = X'"(pf')df 

m 

+ ^ MP‘(pf‘) [dy] - Cf'(pf')df), (11) 

V=1 

and the parameter probability is governed by: 


dny = tt; 


Pi 


£(cf'(pf')-c;)(ufyr-c;df) 


V=1 


, ( 12 ) 


where cf = 2f=i 

Here again, the lemma below provides another for¬ 
mulation of this particle quantum filter that mimics the 
discrete-time setting of theorem|2 









Lemma 2. For each I e {1,..., r), the particle quantum 
filter (II 11 1 and (I12l l can be formulated as follows: 




f’' 

t+dt 


■PI 


dy[,dr 


M'l 






where djt stands for (dyjdyf) and where is a 

partial Kraus map depending on p. Ay e R!” and At >0 
given by: 


j(P 

Ay, At 


(P) = Ky,AtP [Ky,A) -tjDht 

y=l 


and is the following operator on FI: 


Ky,At-I'H- 


m \ m I— 

iHP + Y^(LP)^LPl2 Af + ^^T/^A/L; 

y= 1 / y= 1 


The proof is very similar to the proof of lemma [T] 
It relies on simple but slightly tedious computations ex¬ 
ploiting It5 calculus. Due to space limitation, this proof 
is not detailed here. This lemma, combined with the 
mathematical machineries exploited in |[T], opens the 
way to an extension to the diffusive case of theorem|2 


4. An experimental validation 

The estimation of the detection efficiency is con¬ 
ducted on a superconducting qubit whose fluorescence 
field is measured using a heterodyne detector GSlIIl. 
For the detailed physics of this experiment, see EE). 
The Hilbert space Fd is C^. The system dynamics is de¬ 
scribed by a stochastic master equation of the form (|6|l, 
with m = 3; qi = 772 = is the total efficiency of the het¬ 
erodyne measurement of the fluorescence signal; 773 = 0 
corresponds to an unmonitored dephasing channel; 

r~r^ - lY I'Y' 



0 500 1000 1500 2000 


Number of Trajectories 

Figure 1; First estimation, with pattern values 771 =0.10, 
the parameter value 772 = 0.26 close to 77 , and 773 = 0.40. 
Only the first 2000 trajectories are needed to select 77 » 
0.26 and discard 0.10 and 0.40. 


the measurement sample at time t^ - kAt, A: 6 {1 ,...,50), 
corresponds to the two quadratures of the fluorescence 
field Ayi andAy^ From 

lemma| 2 ] we derive a simple recursive algorithm where 
(dvj) and df are replaced by (Ay^) and At. Moreover, as 
explained in subsection l2.4l the 3 x 10® quantum trajec¬ 
tories are concatenated into a single one. 

The estimation is done by taking some pattern val¬ 
ues 771 , 772 , ..., 77 r, assuming that the real value T) is suffi¬ 
ciently close to one of them. We begin with a first esti¬ 
mation that keeps a big interval between each possible 
value 77 , of 77 , in order to validate our estimation scheme. 
We then sharpen this estimation by reducing the inter¬ 
vals between each value 77 ,, until arriving to a level of 
accuracy after which no distinct discrimination can be 
performed. The results are given at figures [1] E |3] 
They give the following refinement of the initial cali¬ 
bration: rj - 0.2425 + 0.005. On each of the figures, the 
X-axis represents the number of trajectories after which 
we look at the parameter probabilities rdf and the Y-axis 
displays these probabilities. 


where X, Y and Z are the usual Pauli matrices ini. 
The time constants Ti =4.15 ps and = 35 ps are 
determined independently using Rabi or Ramsey pro¬ 
tocols, which is not the case of 77 . Using a calibration 
of the average resonance fluorescence signal, the mea¬ 
sured vacuum noise fluctuations provide a first estima¬ 
tion of 77 = 0.26 ± 0 . 02 . 

To get a more precise estimation of 77 , we have mea¬ 
sured = 3 X 10® quantum trajectories of 10 ps, starting 
from the same known initial state pg = ''^ 2 ^ . The sam¬ 
pling time At is equal to 0.20 ps. For each trajectory. 


5. Conclusion 

We have shown that particle quantum filtering is 
always a stable process. We have proposed an origi¬ 
nal positivity preserving formulation for systems gov¬ 
erned by diffusive stochastic master equation. A first 
validation on experimental data confirms the interest of 
the resulting parameter algorithm. This positivity pre¬ 
serving algorithm appears to be robust enough to cope 
with sampling time of more than 2 % of the characteris¬ 
tic time attached to the measurement. The convergence 















Figure 2: Second estimation, realized with more nar¬ 
row intervals between each pattern values. We notice 
that T] is actually closer to 0.24 than 0.26, the calibrated 
value, and that the number of trajectories required for 
the discrimination has drastically increased to 1x10^. 




Figure 3; Last estimation, with very narrow intervals. 
We use all the trajectories available, i.e. 3 x 10® tra¬ 
jectories. Filter does not converge to a distinct choice 
between 0.240 and 0.245. 


characterization of such estimation scheme remains to 
be done despite the fact they are always stable. 
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